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to illustrate what a system of the IDCMS type must be able to do to 
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PRESPECIFIED EVENT SEQUENCES IN INSTRUCTIONAL EXPERIMENTS: IMPLICATIONS 
FOR IDCMS 

Joseph F. Follettie 

Event sequences usually are pre^peclfied in experiments. During 
execution of an experiment, E controls experimental events independently 
of characteristics of monitored performance. A minor exception to this 
rule is that S can cause experimental events to occur somewhat more 
quickly than the limiting slowest speed at which they are programmed to 
occur if he responds in less time than event programming allows. Instruc- 
tional experiments at SWRL increasingly allow S to speed the pace of 
events by responding quickly. However, programmed response time tends 
to be a sufficiently minor component of most such experiments that the 
effect of differential response speed Is to spread S's only modestly 
over an experimental event sequence when they start out at the same 
point in the sequence during a given session — e.g., 25-30 minutes. Even 
so, when two or more Ss begin from the same point in an event sequence 
and negotiate the event sequence at the same time, it is inevitable 
that they soon will be at different points in the. sequence when rate 
of advance of the event sequence is made conditional on response speed. 
Hence, an event-control system applicable' to execution of instructional 
experiments necessarily will allow the different Ss who participate 
in an experimental session under system control to proceed through the 
sequence at different rates. The/ SWRI. Instructional Development Con- 
trol and Monitoring System (IDCMS) has this capability; it allows six 
Ss participating in a given session to proceed at different rates through 
a given event sequence. 

Jus.t how far such a capability extends remains to be determined. 
For example, the difference between an event sequence that will allow 
six Ss of an instructional experiment each to have a minor effect on 
rate of advance of events while participating in the experiment for 25 
minutes and a series of event sequences, one applicable to each of six 
Ss participating in such a session, is on the order of a fivefold or 
sixfold difference in the storage-retrieval-reproduction-control burden 
placed on the system. The optimal instructional experiment routinely 
would control for time-of-day effects. To do so requires representing 
each treatment equally often at each time of day in which sessions are 
scheduled. Thus, we must eventually require systems of the IDCMS type 
to serve at least as many Ss as there are treatments in the instructional 
experiment anA to (partially) control event occurrences belonging to as 
many different sequences as there are treatments in the experiment,. 
Thus, if the experiment features four treatments, Lhen the requirement 
for input-output terminals is four or a multiple of four and the require- 
ment for control span is four session-long event sequences. If the 
experiment features six treatments, then the requirement for terminals 
is six or a multiple of six arid that for control span is six such 
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sequences. The system's capability for effecting (partial) event con- 
trol should be evaluated for the illustrative six-treatment instructional 
experiment to be described. 

Altbpugh response-monitoring functions will be vested'in E' in 
remarks that follow, IDCMS has a response-monitoring capability for 
certain types of responses not of interest here. The system's capability 
for monitoring responses contrasts with its capability for monitoring its 
own event-control and response-monitoring behavior. In the event-control 
domain, an assumption that the system can control an event sequence of 
interest referencing to several Ss served at the same time is an assump- 
tion that the system can monitor its own event-controlling behavior 
consonant with required event- control . It is redundant to speak of an 
event-control capability and a capability for monitoring event-control- 
ling behavior consonant with events-control. 

Current instructional experiments typically are conducted in a 
manual mode; this term simply signifies that E is considerably^burdened 
with response-monitoring and event-controlling activities during the 
conduct of an experiment. The consequence typically is a series of 
costly compromises which, on the one hand, reduce the usefulness of a 
datum and, on the other hand, make the cost of a datum so high that 
one seldom can afford the volume purchases of data that resolution 
of complex instructional problems requires. An optimal alternative 
to manual mode execution of instrihitional experiments is automatic 
mode execution. Study execution would be in automatic mode if E's 
presence in the response-monitoring and event-sequencing roles were 
unnecessary. Moreover, the well-documented advantages that machines 
enjoy over people when complex clerical behaviors are required should 
insure a diminution in costly compromises duiing study formulation as 
s one moves away from manual mode execution and toward automatic mode 
execution. IDCMS vfill not make E's presence unnecessary, but it pro- 
mises to relieve E of some event-controlling (and, in some 'situations , 
^response-monitoring) functions. In consequence, the system promises to 
move instructional experimentation in the direction of automatic mode 
execution — an important implication of which is that such experimenta- 
tion can increase in complexity as the phenomena under study warrant. 
The primary purpose of this paper is to specify a minimal set of char- 
acteristics that IDCMS must possess to relieve E of an appreciable 
amount of the event-control portion of his current manual-mode, study- 
execution burden. We do this by indirection. That i3, an instructional 
study now in formulation is described well enough to guide those charged 
with system exploitation and evolution concerning how the system will be 
used in support of SWRL instructional research. The illustrative study 
will be executed in manual mode; we ask the systen\ to support execution 
of such studies in such a way that study effectiveness will be enhanced 
through diminution of a need to make compromises stemming from event- 
controlling limitations of E and study efficiency will be (considerably) 
enhanced in the cost-return sense. 
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A study now being formulated by John Koehler illustrates the sort 
of instructional experiment we wish to be able to prepare for and 
execute routinely and cheaply at SVrRL. Unlike experiments that typify 
the instructional research domain, the Koehler study rises to the 
challenge ,posed by the instrui^tTonal problem, which is complex • Even 
so, manual-mode resources have necessitated some compromises with what 
we view as an effective response to the problem; manual-mode study 
execution .precludes the rate of return in findings that we must have 
to-reax:h definitively effective instructional designs in less than the 
long term. An acceptably useful IDCMS will permit both the study of 
more-complex event sequences than the Koehler study will evaluate in 
manual mode and the pursuit of a sj\arply accelerated rate of return in 
findings per unit resources. • ' 

Although the emphasis below will be on sequencing-control of experi- 
mental events, IDCMS has other functions that bear only slightly less 
on improved effectiveness-efficiency of instruction research. A few 
comments on these other functions are in order. All visual displays 
to be used in>. the Koehler study are alphanumeric (or, even more narrowly, 
"alphaic," since each is composed exclusively of at most four alphabetic 
characters). Research efficiency would be enhanced if the system's 
character generater could be used to produce camera-ready materials 
underlying the loading of such materials into the system's video (frame) 
storage. While the matter requires evaluation, my guess is that the 
system in Version 1 configuration \A-'H'"1iave such a capability. ' 

A rough estimate is that the Koehler study will require at most 
400 unique visual displays (slides in projector terminology, frames 
in system terminology) . Manual mode execution of the study necessitates 
much duplication of the basic se't of 400 frames. That is, to hold E's 
event-controlling burden within reasonable bounds, it is necessary that 
a set of approximately 1750 slides per E be prepared » sorted, and stored 
for use during study execution . l^Jhile the study as formulated will pro- 
cess Ss four at a time, if it were executed in manual mode under con- 
ditions comparable to execution under partial system control. It would 
process Ss six at a time. -To do this would necessitate that 10,500 
slides be prepared, sorted, and stored for use during study execution. 
Actual manual-mode execution will necessitate that each basic slide on 
the- average be duplicated on the order of 17 times; manual-mode execu-- 
tion that is comparable to execution under system support would neces- 
sitate that each basic slide on the average be duplicated on the order 
of 26 times. While the matter requires evaluation, my guess^is- that 
the system in Version 1 configuration would' necessitate no^'dupllcation 
of visual displays whatsoever. That is, ^ -en if it were required that 
a given visual display be placed in the system's vis|ial store on more 
than one track, the same single camera-ready display could be used for 
this purpose. However, duplication even in the sense of multiple storage 
addresses, if required, will be minimal, because each S is provided with 



a video buffer to which the frame in master video storage can be dupli- 
cated. In consequence, if the system can produce Koehler study visual 
displays in camera:-ready form, then if the cost of a single display is 
50 cents, the study under partial system control would cost $200 for 
materials preparation, while a comparable study in manual mode would 
cost over $5000 for materials preparation. Unfortunately, this is not 
the entire cost of large materials requirements based on a high level 
of duplication. Inevitably, response time is a function of the materials 
requirement. In some sense, materials requirements of the magnitude 
inherent in the Koehler study necessitate waits that set ^back study 
execution. In some sense, this necessitates in turn that specialized 
professional stafi will be less effectively employed than would other- 
wise be^thexaseT 

While the Koehler study tends to fall at the upper end of a scale 
for complexity of instructional research as this is conducted in coh- 
temporary research settings, it tends also to fall at the lower end of 
such a scale when the scale is defined on SWRL requirements for infor-^ 
mation that resolves germane instructional problems. Hence, the quanti- 
tative implications of the Koehler study for audio and video storage 
must be taken as underestimates of .the systenr-burdening requirements 
that such a system must be able to handle in the years immediately ahead. 
A temptation was for the most part resisted to make the illustrative 
study more complex than the Koehler study because it is more difficult 
to argue away the inconvenient facets of actual work than it is to argue 
away the inconvenient facets of hypothetical work. 

The Koehler study features six instructional treatments, each 
applied to one treatment group of 12 Ss over three successive test-train- 
test cycles. Ss are K-level. The Koehler schedule calls for preli- 
minary entry skills evaluation on Day 1, Cycle 1 training on Days 2-3, 
Cycle 2 training on Days 5-6, Cycle 3 training on Days 8-9, and inter- 
vening post-training and entry skills testing on Days 4, 7, and 10. 
One of the few liberties we take with Koehler's formulation is to col- 
lapse the schedule to eight days, with testing occurring on Day 1 and 
toward the end of Days 3, 6, and 8. The intent here is not pedagogical, 
but rather to' stress the system a bit more than the Koehler schedule 
would . 

It is assumed here that the system should store, consonant with 
momentary retrieval and reproduction to S's audio and video buffers, all 
of the materials that will be used during one experimental day. This 
assumption frees us to schedule sessions tightly so as to fully exploit 
the school day; this, in turn, creates most-favorable system amortization 
conditions. The object is to schedule the .Koehler experiment so that 
the worse-day storage requirement can be identified. The basis for such 
scheduling, while straightforward, involves production of much detail. 
This detail, in the form of flowcharts and tables, is presented in Appen- 
dix A, together with a more e;:tensive description of the study than will 
be provided here. Koehler has instituted a two-way control for amount 
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of training across treatments within cycles: a) number of training res- 
ponses per treatment per cycle and b) associated training time. V7e use 
his values for number of training responses and a framework that appears 
compatible with IDCMS to estimate associated training times. While 
training times as deirived in Appendix A are characterized as those for . 
an S whose response speed is a median value, the possibility of variation 
in response speed in a study of the Koehler type is over a constrained 
range. Hence, these times do not probably seriously underestimate train- 
ing times for the slowest-responding study S» The training-testing 
schedule to be presented assumes the following: 

1. Thirty-minute sessions wherein six minutes are given over to 
housekeeping events and rest breaks. Hence, study event time is on the 
order of 24 minutes. 

2. Twelve consecutive sessions per school day, beginning at 8:30 
a.m. and ending at 2:30 p.m., with six Ss participating in each session. 
Hence, the study N of 72 Ss in toto will participate during each experi- 
mental day. (This is no mere extraneous requirement, A persistent 
problem of most instructional research is that different batches of" 
children enter the experimental situation at different points in the 
school year. This is relatively unimportant at higher-grade levels but 
can be devastating at the K level. While confounding procedures exist 
whereby one can control for effects of different amounts of prior school 
experience, this can only be done at a cost in error variance; this 
cost can also be characterized as a cost in study efficiency.) 

Since Day 1 performance conditions assignment to groups, Day 1 
ocperimental events will be confined to a preliminary entry skills test. 
In consequence, 10-minute sessions will characterize Day 1. Sessions 
on all other days will be 30 minutes. Table 1 shows how the Koehler 
study would be scheduled consonant with the data presented or derived 
in Appendix A .and foregoing assumptions. The derived training times 
reflected in Table 1 meet Koehler *s requirement th^t each treatment 
group receive about the same amount of training during a given cycle 
(see also Tables A-21 and A-22) ; they also appear consonant with Koehle'r's 
views on training time expenditures that the study will encounter. ' 

/ 

For many compelling reasons that go beyond the purview of this,/ 
paper, the system must eventually evolve to ^ point wherein it permits 
on-line rapid composition of programs from the fewest number of elements 
that are consonant ,with such an objective. However, Appendix A defines 
the program as a unitary entry in storage such that the requirments on 
the system are only those of retrieving a program on commanii and repro- 
ducing it to the buffer of the S who is ready to. negotiate the program. 
Events within a given program occur in fixed sequence. Table 1 reveals 
that, for a given treatment group, the programs that apply. to the group 
themselves will be negotiated in fixed sequence. All that will vary 
across two or more Ss negotiating a given stretch ot a treatment set 
of programs during a given session is that these Ss may vary just a 
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Table 1 

a 



Training-Testing Schedule, by Treatment Group and Type of Program 



Type of Treatment Group 

Day Program 

SI Bl CI ,S2 B2 CZ 



ET-1 / 7.5 7.5 7.5 . 7.5 7.5 7.5 



1/Tl.O 3.3 3.3 3.3 3.3 

1/T2.1 19.0 9.7 

1/T2.2a ■ 9.6, 5.0 

1/T?..2b 9.7^ 5.1 

1/T3.0a 2.1 2.1 2.1 2.1 ■ 2.1 2.1 

1/T3.0b. 2.1 2.1 ■ 2.1 2.1 

1/T3.0C 6.8 6.8 6.8 6.8 

1/T4.1 13.0 

1/T4.2a 

Totals ■ 24.4 24.0 24.0 24.7- 23.5 24.4 



1/T3.0b 


2.1 






2.1 






1/T3.0C 


6.8 






6. .8 


. / 




1/T4.1 




9.1 


9.7 




6.5 


1/T4. 2a 












1/T4.2b 










9.7 


3.5 


PT-1 


6.7 


6.7 


6.7 


6.7 


6.7 


6.7 


ET-2 


7.5 


7.5 


7.5 


7.5 


7.5 


7.5 


Totals 


23.1 


23.3 


23.9 


23.1 


,23.9 


24.2 



4 2/Tl.O 5.8 5.8 ■ 5.8 5.8 

2/T2.1 18.2 18.5 

2/T2.2a 17.5 8.2 

2/T2.2b 5.0 
2/T2.2C - 5.1 

1/T3.0a 2.1 . 2.1 

1/T3.0b 2.1 2.1 

1/T3.0C 6.8 6.8 

2/T4.1 13.0 

2/T4.2a lli5 

Totals 24.0 24.0 2A.3 23.3 23.5 24.1 



^All entries are in minutes. 
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Table 1 - don't inued 



• Type of . ' Treatment Group 

Day Program 

SI Bl CI S2 , B2 C2 



27T2.1 18.4 

2/T2.2b 11.8 

2/T2.2C . ' 9.7 

1/T3.0a 2.1 2.1 2.1 2.1 

1/T3.0b 2.1 2.1 2.1 2.1 

1/T3.0C 1.4 ■ 6.8 6.8 

2/T4.1 24.0 13.0 

2/T4.2a 6.5 

11.8 5.0 
12.2 1.5 



2/T4.2b 



■ Totals 


24.0 


24.0 


24.0- 


25.7 


24.0' 


24.0 


6 1/T3.0C 


5.4 






6.8 






2/T4.1 




5.7 


5.5 






8.0 


2/T4.2C 










6.3 


PT-2 


6.7 


6.7 


6.7 


6.7 


6.7 


6.7 


ET-3 


7.5 


7.5 


7.5 


7.5 


7.5 


7.5 


. 3/Tl.O 


4.6 




4.6 


3.6' 


2.6 


2.5 


2/T3.0a 




2.6 








Totals 


24.2' 


. 22.5 


24.3 


24.6 


23.1 


24.7 



3/Tl.O 
3/T2.i 
3/T2l2a 
3/T2.2b 
3/T2.2C 
2/T3.0a 
2/T3.0b 
2/T3.0C 
3/T4.1 

3/TA.2a * : 12.5 









1.0 




2.1 


18.7 




9.1 














11.3 ■ 




, 5.1 








5.2 




2.8 








3.7 




2.1 


2.6 




2.6 


2.6 




2.6 


2.6 


2.6 


2.6 




2.6 


■ 2.6 




8.8 


8.8 




8.8 


6.7 




12.6 











Totals 23.9 24.0 23.1 23.8 23.9 24.0 
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Table 1 - continued 



Type of Treatment Group 

Day Program 

SI Bl. CI S2- B2 C2 



8 . 2/T3.pb 
2/T3.0C 
3/T4.1 
3/T4.2a 
3/-T4.2b 
PT-3 

■ Totals 15.5 17.8 16.4 18.1 18.0 . 20.4 



I 



^ 2.6 

8.8 8.8 2.1 

11.1 9.7 

6.5 

^. 11.3 5.1 

6.7^^ 6.7 6.7 6.7 6 .7 6.7 
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little in time to completion of that stretch. Table 2 shows day-to- 
day storage requirements that the Koehler study, as scheduled in Table 
1, requires. Vfe take these requirements as those that must be met on 
a momentary basis; that is, the system must be able co retrieve and 
duplicate to an^ appropriate buffer any of the materials applicable to 
an cxperimerjt^lL day at any time during any session of that day. 

The worst case days for number of audio programs are Days 4 and 7. 
In either case, the system must store in audio master reproduction AO 
short programs. It is my impression, but requires evaluation , that 
such a storage requirement underlying quick retrieval and duplication 
to an appropriate audio buffer is well within system capability in 
current configuration. A matter that should be explored more fully is 
whether the system can handle the program repetitive and interrupt 
functions described in Appendix A. These programs are designed so ^s 
to require audio buffer to stop between subprograms and to rewind to 
program beginning as multiple trials of the Koehler study require. 

The worst-case day for amount of audio tape—in norma 1-pLay, tninutes 
is Day 6. It is apparent that all requirid audio programs are at least 
fivefold shorter than th^p system will allow. Hence, the information on 
program length is less crucial than that on number of programs. However, 
it is instructive in the\sense that it documents the research staff con- 
tention that the present hardware cpn^iguration of IDCMS wastes most of 
the audio program storage, that it provides, when judged against SVmL 
research requirements. We may find it necessary in t:^.me to require the 
system to store more than ^96 different audio programs. It is doubtful 
that we ever will require It Lo. stqre more than 96 x 15 (or 25) minutes 
worth of audio programs. The 15 ' (or 25) minute program length engineered 
into the system iri present configuration is virtually useless when 
instructional research is to be supported. 

Day 6 is a worst-casl day for video frame storage. While the 106 
frames requi^ng storage on Day 6 poses no problem in light: of the 1800- 
track video storage capability, the l6-file view of video storage that 
underlies current system engineering is inconsonant with the Table 2 
Day 6 requirement that these 106 frames reference to 38 different audio 
programs.^ \ftiile many of these programs share the isame video frames 
(the 12 PT-2 programs, for example), these frames , must appear indifferent 
orders in the different programs. A central matter requiring early eval- 
uation is whether the system in current configuration can yield the video 
correlation to audio programs which Day 6 (and, iri fact, every other 
experimental day of the Koehler study) requires. If not, then priority 
must be given to securing such a capability, for it becomes a bottle- 
neck that sharply constrains the uses to which the system can be put. 

While not of central concern here, it requires comment that a 
system that is consonant with requii^.ements summarized in Tables 1 and 
2 surely would effect a variety of economies for which instructional 
research would be a prime beneficiary. Remarkable staff savings in the 
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Table,2_, 



^ a 
Per Day Materials Storage-Retrieval Requirement 



. Type of 
Day Program 



Number of 
Programs 



^yii.o 
2/1:2.1 

2/T2.2a 

2/T2.2b 

2/T2.2C 

1/T3.0a 

1/T3t0b 

1/T3.0C 

2/T4.1 

2/T4.2a 

Totals 



Program 
Length 
Onih) 



V Firames 
/Program 



Total 
Tape . 
(min) 



40 



54.4 



Total 
V Frames 



1 . ET-1 


• 6 


3.1 


28 


18.6 


28 


^ 


• ; 

2 ' 1/Tl.O 


4 


.5 


2 


- 2.0 


4 . 


■ 1/T2.1 


4 




4 


4.0 


8 


\^ 1/T2.2a 


4 


1.5 


6 


6.0 


12 


1/T2.2b, 


4 ^ 


1,0 


4 


4.0 ■ 


8 


\ 1/T3.0a' 
1/T3.0b 


4 


.8 




'3.2 


12 




4 


.8 


■6 


3.2 




1/T3.0C \ • 


4 


1.6 




■ 6.4 






' ' 1/T4.1 \, 


4 


U.O 


4 


4.0 


8 


1/T4.2a 




2.0 ) 


8 


8.0 


16 


Totals 


36 


/ 
/ 




40.8 


68 



3' 1/T3.0b 


4 


.8 




3.2 


[-] . 


1/T3.0C 


4- 


1.6 




6.4 


8 


1/T4.1 


4 


1.0 


. 4 


4.0 


1/T4.2a 


4 


2.0 ■ 


. 8 


8.0 


16 


1/T4.2b 


4 


1.0 


4 


4.0 


8 


PTrl 


• 12 


2:0 


20 


24.0 


20 


ET-2 


6 


3.1 • 


28 


18.6 


28 


, Totals 


38 






68.2 


92 


\ 













4 




.9 


4 


\3.6 


8 


4 




2.0 


4 


's^.o 


8 


4 




1.0 • \ 


4 


4.0 


8 


4 




1.5 


^ 6 


6.0 


12 


4 




1.0 


4 


4.0 


8 


■4 




.8 


[^] 


3.2 




4 




.8 


3.2 




4 




1.6 


6.4 




4 




2.0 


4 


8.0 


8 


4 




2.0 


8 


8.0 


16 



80' 



^Bracketed frame entries are coininon to sets of T3.0 programs, 



ERIC 



11 

# 

Table 2 - continued 



Type of Number of Program V Frames Total Total 

Day . Program Programs Length /Program Tape V- Frames 

(min) (min) 



2/T^.l 


4 


2.0 


4 




8 


2/T2 .2b 


■ k 


1.5 


6 


6.. 


• 12 


2/T2.2C ' 


k 


2.0 


8 


8.0 


16 


1/T3.0a 


4 


.8 




3.2 




l/JC3^0b' 


. k 


.8 


6 


3.2 


Y>. 


1/T3.0C 


k 


1.6 




6.4 


8 


,2/T4.1 


4 


2 .0 > 


4 


8.0 


2/T4.2a 


4 


2.0 


8 


8.C 


16 


2/T4.2b 


2 


1.5 ' 


6 


3.0 


12 


2/T4.2C 


4 


2.0 


8 


■ 8.0 


16 


Totals 


38 






61.8 • 


100 



6 1/T3.0C . 


4 - 


1.6 ' 


6 


6.4 


12 


2/T4.1 


4 


2.0 


4 


8.0 


8 


2/T4.2C 


4 


2.0 


V ' 8 


8.0 


16 


PT-2 


- 12 


2.0 


20 


24.0 


20 


ET-3 


6 


3.1 


28 


18.6 


28 


3/Jl.O 


4 


.7 


3 


2.8 


6 


2/T3.0a 


4 


1.1 


8 


4.4 


16 


Totals 


■3!3 






72 .2 


106 



3/Tl.O 


4 


.7 


3 


2.8 


6 


3/T2.1 


4 


1.5 


6 


6.0 


12 


3/T2.2a 


4 


1.0 


4 


4.0 


8 


3/T2.2b 


■ 4 


.8 


3 


3.2 


6 


3/T2.2C 


k 


.5 


2 


2.0 




2/T3.0a 


4 


1.1 




4.4 


[■•] 


2/T3.0b 


4 


1.1 


8 


4.4 


2/T3.0C 


4 


2.1 




8.4 


8 


3/T4.1 


4 


1.0 


4 


4.0 


3/T4.2a 


4 


2.0 


8 


8.0 


16 



Totals 



47.2 



76 
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Table 2 - continued 



Tyi.2 of 
Program 



Number cf 
Programs 



2/T3.0b 

2/T3.0C 

3/T4.1 

3/T4.2a 

3AT4.2b 

,PT-3 

Totals 



Program 
Length 
Cmin) 



V Frames 
/Program 



Total 

Tape 

(min) 



4 
4 

4 

4' 
12 



1.1 
2.1 
1.0 
2.0 
1.0 
2.0 



32 



[«1 

4_ 
8 ' 
4 

20 



4.4 
.8.4 
4.0 
8.0 
4.d 
24.0 



52.8 



Total 
V Frames 



8 
16 

8. 
20 



68 
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form of more apt use of specialized personnel should result; these 
savings would be transformed into the higher rate of acquisition of 
germane findings we must have to achieve definitively effective instru 
tional desi^gns in less than the long term. 
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APPENDIX A 
OUTLINE OF THE KOEHLER STUDY 



A study now being formulated by John Koehler illustrates contem- 
porary instructional experiments. While this study will be conducted 
in the manual mode during Spring 1972, we view it from a system control 
standpoint. We ask what characteristics a con4:rol-monitoring system 
must have to permit ^shifting most of the event control burden of manual 
mode execution of the Koehler study from E to the system. 

The study compares alternative instructional treatments of a phonics 
approach to reading for effectiveness. Excepting that treatment groups 
are formed on the basis of comparable germane entry skills, no face.t 
of the study is conditional on any characteristic of .S's performance. 
Each 01 several types^ of response to be studied must occur in less 
than a generous amount of time. To minimize subsequent data reduction, 
E will (quickly) evaluate responses as th^se occur. Were the study 
under system control, E would feed the proper evaluative code to the 
system for recording immediately following each response. 

The study occurs in three cycles. These cycles differ ^primarily 
in the lexical-phonemic structure of the words whose processing is to 
be instructed and tested. Cycle 1 features CVC words (e.g., SAP)j , 
Cycle 2, CCVC words (e.g., SNIT) ; Cycle. 3, CVCC words (e.g., SINK). 
Each cycle is characterized by its own 3-segment entry skills test and 
its own 3-segment post-training test; the intervening training^or a 
cycle consists of one of six training treatments each of whicfi is further 
differentiated according to which of two sets of instructional materials 
is^ used . 



ET and PT Tests 

Denoting entry tests ET, post-training tests PT, test segments A, 
B, C, and cycles 1, 2, 3, then test notation is as shown in Table A-^l. 

All Ss receive ail tests'" in the progression ABC. Segment C post- 
training subtests~PTC-l, PTC-2, PTC-3~are in two alternative versions, 
one appropriate to half t-^e Ss and the other appropriate to the other 
half. Otherwise, testing is identical across Ss, regardlps of ''training. 
Described in order below are: a) ETA and PTA subtests and associ^^ted 
control requirements, b) other subtests, and c) cycle-bwcycle ET^and 
PT storage requirements and the time it will take to tesi the 72 Ss 
used in the study when six Ss at a time are tested undery system control. 
Testing and training time values are 'of interest because single day 
(or session) storage requirements stem from timing a sdidy over sessions 
and days using such values. / 
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Table A-1 

Test and Subtest Notation and Progression of Activities 



Cycle 1 Cycle 2 Cycle 3 



8 



4^ ET::! Tng PTzl Mil ^ng PTzl EEll ^ng PT=3 

ETA-1 PTA-1 ETA-2 PTA-2 ETA-3 PTA-3 

ETB-1 PTB-1 ETB-2 , PTB-2 ETB-3 PTB-3 

ETC-1 PTC-1 ETC-2 PTC-2 ETC-3 PTC -3 
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ETA and PTA Subtests 

ETA subtests differ in form from PTA subtests only in that ETAs 
consist of an example followed by six test items, whereas PTAs dispense 
with the example. (Different items are used on the two subtests; how- 
ever, this is a difference in content rather than form.) Por purposes 
of analysis, the only significance of an example, is that the subtest 
will consist of seven or six items. 

Examples and test items all have the following form: 

1. A video frame (V i.l) containing two printed words (Wi on the 
left, W2 on the right) is presented with an audio accompan3mient (A i) 
that pronounces first and then W2. 

2. Then V i.l is superseded by V i.2, wherein Wi is at top left, 
W2 i's at top right, and W3 is boxed at bottom^ center. I 

3. S is required to attempt pronunciation of W3~SRi = Try /W3/ . 
(Slant brackets" indicate audio presentation or aural responding.) S is 
encouraged to make Sj^i as quickly as he can (communicated beforehand 

\ during an interval that precedes system control of the testing sequence 
5 is allowed at most 12 seconds from onset of V i.2 to complete the 
response . , - / 

4. As soon as S responds, E quickly evaluates the response and 
then immediately addresses the system. , If the item is an example 
rather than a test item, then E presses an Ex button, signifying an 
order to advance without recording — E^i = Ex (a command). If the res- 
ponse is to a test item, E presses one of eight evaluation code buttons 
signifying an order to advance, coupled with orders to record the code 
and a suitable response time measure — E-^i = Code i.^ 

>. 

There ar^*, three versions of each -ETA and PTA,** one for each cycle 
of the study. :Desirably, the order of test items would be varied for 



4he Koehler study will make do with a single visual frame — V i 
rather than V i.l + V i.2~because this lessens the materials prepara- 
tion and frame presentation burdens. IDCMS should be required to make 
such a compromise unnecessary. 

^The Koehler study will not collect response time measures because 

to do so would add to an already extensive burden placed on E. IDCMS 

should be required to make such relinquishment of relevant data unnec- 
essary. 
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each version of each subtest. Treatment grc^up size is consonant with 
our providing six orders for each six-item subtest~e.g. , 1st: 123A56, 
2nd: 564312, 3rd: 216543, 4th: 345621, 5th: 652134, 6th: 431562. 

Required th^t each of 3 ETAs and 3 PTAs (and all other subtests)' 
occur in 6 versions that differ only for test item order, one's choices 
are to require the system to compose tests on-line (or nearly so) from 
item files fbr each subtest or to store the different versions as 
fixed sequences. The system in Version 1 configuration cannot do the 
former unless\ somewhat modified. Whether it can do the latter without 
modification depends on how many audio programs ^and associated video 
frames are .to pe stored, together with extent of these files. The 
paper to which) this analysis is appended suiinnariEes storage requirements- 
e.g., the requirement for one day (or session) of study execution. 
Below we will Evaluate the normal-play extent of audio tap^ and the 
number of video frames that the ETA and PTA requirements outlined above 
entail. / \. 

Figure A-1 shows the event control scheme over time for an\ETA 
or PTA item. ^According to the scheme, each item's audio componen^ will 
require 9 seconds of single-track tape (with message and. 55 Hz codes 
merged), or 33.75 inches of tape. Associated with this audio element- 
will be 2 video frames. Thus, a given version of ETA will use 63 
seconds of tape and 14 video frames. Assuming file identification needs 
that are additional to the foregoing, then a version of ETA might be^ 
taken to require 1.2 minutes of audio tape and 15 video frames. We 
call such a tape an audio program . It is assumed that every presenta- 
tion or presentation sequence will have an audio program that entv^,rs 
into system control of the presentation. This will be true whe.ther 
presented stimuli are audio, video, or audio + video. A version of PTA 
will require 1.0 minutes of audio tape and 13 video frames. Based on 
6 item orders multipled^ by 3 cycles, program requirements in support 
of Segment 1' testing are: 

1. 18 audio programs of 1.2 minutes duration (21.6. minutes) + 45 
video frames (15 frames x 3 cycles) for ETA. 

2. 18 audio programs of 1.0 minutes duration^ (18 minutes) + 39 
video frames (13 frames x 3 cycles) for PTA. 



^The Koehler study will not vary\test item order for subtests 
because to do so under manual administration would risk attributing a 
wrong order to a given S; E has tooxmatty other things to dp during 
manual administration. IDCMS should be required to make such a com- 
promise unnecessary. 
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Other Subtests 

All ETB, ETC, PTB, and PTC subtests will consist of 6 test items 
without a preceding example. Pigures A-2 and A-3 show event control 
schemes for ETB and ETC items, respectively. Figures A-4 and A-5 show 
such schemes for PTB 'and PTC items. PTB items require different types 
of responses, depending on whether training features a single-letter or 
bi-part strategy (the training strategic factor of a 3 x 2 design for 
training treatments). PTC items require different types of item pre- 
sentation, depending on whether training features a single-letter or 
bi-part strategy. PTC subtests therefore reflect two alternative ver- 
sions per cycle, one that tests for effects of the single-letter train- 
ing strategy and one that tests for effects of the bi-part training 
strategy. 

Figure A-2 indicates that each ETB item will use 7.5 seconds of 
audio tape and 2 video frames. Hence, an ETB subtest will use 45 
seconds of tape and 12 video frames. Using the reasoning applied ear- 
lier to ETA, we increase the requirement to 53 seconds of tape and 13 
video frames. Figure^ A-t3 indicates that each ETC item will use 8 
seconds of ai.dio tape—there is no video requirement. Hence, the ETC 
subtest will use 48 seconds of tape, \^±ch we increase to 56 seconds. 
Figure A-4 indicates that each PTB item will use 3.5 seconds of tape , 
and 1 video frame. Hence, a PTB subtest will use 21 seconds of tape 
and 6 video frames, which we" increase to 25 seconds of tape and 7 video 
frames. Figure A-5 indicates that each PTC item will use 3.5 seconds 
of tape—there is no video requirement. Hence,. -the PTC subtest will 
use 21 seconds of tape, xAich we increase to 25 seconds. 

Program requirements in support of Segments 2 and 3 testing are: 

1. 18 audio programs of .9 minutes duration (16.2 minutes) + 39 
video frames for ETB. 

f 

2. 18 audio programs of 1 minute duration (18 minutes) for ETC. 

3. 18 audio programs of .5 minutes duration (9 minutes) + 21 
video frames for PTB. 

4. 36 audio programs (3 cycle versions x 2 training -strategy 
versions x 6 test item orders) of .5 minutes duration (18 minutes) for 
PTC. 

Cycle-by-Cycle Summary i 

Table A-2 shows required program materials by cycle and test. It 
is worthy of note that the three segments of a test wiil occur in fixed 
sequence. Hence, the segments of ET tests can be stored as single pro- 
grams (if stop codes are used at the ends of segments) for unitary 
retrieval and reproduction to audio buffer, thus reducing these programs 
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to 6 in number (one per test item order), eadh consisting of 6.1 minutes 
of tape, referenced to a video file containing 28 frames wliose sequencing 
will be a function of test item order. The same is true for PT tests, 
except that alternate training strategy versions of PTCs necessitate , 
that there be 12 three-segment programs, each 5.0 .ninutes in tape length 
and all referencing to a video file containing 20 frames whose sequencing 
will be a ftinction of test item order. 

- — ^Average item negotiation times for ETA, ETB, ETC, and PTA subtests 
should be on the order of 15 seconds. Average item negotiation timas 
for PTB and PTC subtests, respectively, should be on the order of 12 
and 10 seconds. Exclusive of retrieval-reproduction intervals and ad- 
miniSti:ative time not under system control that is used to give general 
instructions and effect housekeeping arrangements, an S on the average 
would use 15 x 18 seconds, or A. 5 minutes, to negotiate items of any 
ET test and 15 x 6 + 12 x 6 + 10 x 6 seconds, or 3.7 minutes, to negoti- 
ate .items of any PT test. If we allow 3 minutes per test for admin- 
istrative matters and concurrent retrieval-reproduction of programs to 
audio buffer, then each entry skills test on the average will use 7.5 
minutes ,of S's (and so- of the system's) time; each post-training test 
on the average ^d.11 use 6.7 minutes of S's time. 

Testing 72 Ss on a given entry test on the average will cost 12 x 
7.5 minutes, or 1.5 hours, when tests are system-controlled and 6 Ss . 
are tested at a time. Testing 72 Ss on a given post-training test on 
the average will cost 12 x 6.7 minutes, or l.A hours. The total testing, 
program under these conditions will cost 3 x 1.5 hours + 3 x 1.4 hours, 
or 8.7- hours . 



Assignment to Treatment Groups 

Ss will be assigned to treatment groups on the basis of performance 
on ET-1. Each item will be scored for correctness of initial (i), 
medial (m) , and terminal (t) features or portions of the response. A 
response will be scored R (correct) in the Koehler study if all portions 
of the response are correct and W (incorrect) if none are correct. It 
will be scored R1-R3 if two portions — im, it, mt — are correct and R4- 
R6 if one portion--!, m, t-7is correct. 



^A truly automatic-mode system would both monitor and evaluate res- 
ponses and would store both the monitored response and its evaluation 
code. A monitored response is one that is apprehended in the form given- 
the so-called raw datum. If S responds "No'* to an item, then a monitor— 
whether human or mechanical--is sal-: to have monitored that response if, 
on demand, the monitor can convey that S's resp6nse .was "No." Latency 
or response time values also can be monitored/ An evaluated response 
is one that is compared with a set of criterion specifications bearing 
on response accuracy, speed, or both. The/simplest evaluated response 

/ 

/ 
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While Koehler presently can specify* the sorts of "skills profiles" 
that will occasion controlled assignment of Ss to treatment groups, he 
will not know until Cycle 1 entry skills testing is completed just what 
sorts of skills profiles and proficiency levels the K-level Ss bring 
to such a study. In consequence, he views assignment to treatment 
groups as a task for E, r.ither than as a task for an appropriately- 
instructed control and monitoring system. That is not to say that 
follow-on studies might not use the system to aid assignment of Ss to 
treatment groups. ' 

' Whether or not we give the system a role in assigning Ss to treat- 
ment groups, no useful ^purpose would be served by requiring the system 
to react to Cycle 1 entry skills data in an on-line manner. This is 
because assignment to treatment groups cannot occur until all Ss (N = 72) 
have been tested. If we treat S's time as valuable — which it is — then 
we will not have him sit around following entry skills testing while 
awaiting assignment to a .treatment group. The obvious implication is 
that entry skills testing will occur on one day, with training initia- 
ting on a second day. Hence, assignment to groups can occur during 
an intervening 18-21 hour period. The most we could ask of the system 
if it were being used to control execution of the Koehler study is chat 
it summarize Cycle 1 entry. skills test data — by S, subtest, and code 
or code group — and to output these sxintmaries while operating in an off- 
line mode following ET-1 testing of the last S. 



will code the response either as acceptable or unacceptable—right or 
wrong. More complex evaluation schemes — e.g., that for the Koehler 
study — will distinguioli between various levels, or categories of unaccept- 
abiiity. The "real time** evaluated response typically is important in 
experiments only as a time saver; if E can evaluate the response quickly, 
then he might wish to record its evaluation code, rather than the res- 
ponse itself, thereby accomplishing one step in data reduction during 
conduct of the experiment. State of the art control-monitoring systems 
do not permit relieving E of this burden. 

In the Koehler study, E will monitor S's response and will evaluate 
it when made. \^ere partial .event control is ad^complished by the system — 
as will be the case for IDCMS in Version 1 configuration — E will signal 
the evaluation code to the system. While this procedure has small impli- 
cations for the data recording codes that the system will employ and for 
characteristics of the terminal through which E will address the system, 
there are no conditional implications. That is, required system reaction 
is the same whether E signals "Response is completed" or "Response is 
correct." Of passing interest, as executed, the Koehler study will 
both tape responses as ..^ade and record their evaluation codes immediately 
following completion of the response. The tape record will have a fail- 
safe function; it will be scrutinized only if anomalies show up in the 
reduced data. 
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Training Treatments 

All of K^ehler's training treatments stem from a knowledge-based, 
or phonics, drientation to beginning reading. Two primary training vari- 
ables arr sttidied. We denote these emphasis and strategy variables. 
Three categories of emphasis are distinguished: an analytic or segmenta- 
tion emphasis (S) , a synthetic or blending emphasis (B) , and an analytic- 
synthetic or combined emphasis (C) , CThe mnemonic is SBC). Two cate- 
gories of strategy are discerned: a single- letter strategy wherein 
segmentation responses go to the single-letter level (relatively) and 
blending responses come from that level — denoted L— and a bipart strategy 
wherein segmentation responses go to a bipartite level and blending res- 
ponses come from that level — denoted 2_. Where the word is a VC item, 
the two strategies have identical implications, \fliere it is 3-letter 
or 4-letter, the single-letter strategy really is a tripartite strategy, 
which contrasts wth the bipartite strategy. Thus, the study deals (pri- 
marily) with a 3 X 2 matrix of training treatments: 

51 Bl CI 

52 B2 C2 

Of passing interest, the study deals secondarily with a materials 
factor. Apparently-comparable but different mater ials--Versions 1 and 
2 — will be used. Each primary treatment group will be further subdivided 
into materials subgroups, having ns of 6 — denoted Sl.l, SI, 2, . u . , 
C2.2. While it seems improbable that the system could handle a group 
of 6 Ss where one S belonged to each treatment group, we vjill ask it 
routinely to handle a group of 6 Ss half of whom are trained on Materials 
Set A and half on Materials SeL 3. 

Four skills — Tl through TA~are addressed during training. Tl 
through T3 skills are taught to S groups, T3 and TA to B groups, and Tl 
through TA to C groups. These skills could be named as follows: 

Tl - Pronouncing words as units 

T2 - Segmenting words and pronouncing (sounding) the segments 

1 

T3 I Associating the elements of letter-sound rules 

TA - Combining and blending the sounds of segmented words 

Table A-3 shows treatment groups by treatment materials sets. 
Noted earlier, each treatment group further subdivides into two content 
subgroups for materials. These subgroups receive comparable treatment 
materials but using different words reflecting different lettet-sound 
rules . 
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Table A-3 

Treatment Groups, by Training Materials 



Skill Training Materials Treatment Groups 



Tl 




. TL.O 


SI, 


S2, CI, 


•C2 


T2 




T2 .1 


si; 


CI 








T2.2 


S2, 


C2 




T3 




T3.0 ■ 


SI, 


S2, Bl, 


B2, CI, C2 


T4 




T4.1 


Bl, 


CI 








T4.2 


B2, 


C2 





Following sections describe in order the characteristics of eacl^ 
training materials set, associated training times, and program inven- 
tories. But first we discuss some conventions. 

Conventions Used to Establish Training Materials Requirements 

1. Content-defined alternative treatment sets,. Two versions ot 
each set of treatment materials—Versions A and B-p-will be employed 
during every training session. Thus, if the session features T2 train-, 
ing using T2.1 materials. Version A of T2.1 will be used for training ; 
3 Ss; Version B, for training 3 others. 

2. Program item orders. The items of every program consisting of 
two or more items will occur in two alternative orders. Thus there will 
be two item-order referenced versions of each such program. Both of 
these versions will be employed during any session featuring the program 

to which these versions reference. , 

i 

3. Audio programs. The system in present form cannot efficiently 
compose aud-[.o programs on-line from smaller elements . To do so requires 
quicker retrieval of audio elements from audio master reproduction tl|an 
the system permits and the sequencing of these elements, whether prior 
to or during reproduction to audio buffer. An alternative is to store 
audio elements outside the system, to compose minimal nonredundant audio 
programs outside the system, and to load these programs into audio 
master reproduction. Single such programs permit retrieval and repro- 
duction to audio buffer with delay on the order of 15 seconds on the 
average . 
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The Koehler study — and most studies involving instruction — features 
repeated trials for a minimai nonrediindant program or~in some cases- 
repeated trials for such a program followed by a switched item order for 
the same program. Hence, we distinguish between single-trial programs— 
which are nonredundant for content—and double-trial programs— wherein 
the second trial portion repeats first trial content but with switched 
item order. Both types of program are taken as unitary entities for 
purposes of storage in audio master reproduction. Transferred to audio 
buffer, the single-trial program that is to be repeated over n trials 
will require use of a play, rewind, play, etc., sequence. The double- 
trial program will follow a similar sequence, except that a stop code 
intervening between the .program's first and second trial 'portions will 
permit E to use whatever time he requires between trials. For present 
purposes, we assume that a program of either type in audio buffer will 
compel 5 seconds delay between trials. 1 

\^ 

4. General Instructions (Aq). It will be assumed that a general 
instruction Aq will occur at the outset of any training program used 
during any cycle. Were we to tape Aq, then we would neither be able to 
take advantage of retrieval-reproduction delay nor be in a position to 
clarify any question that S might have. Hence, we assign the Aq trans- 
mission function to E. An example of such an instruction keyed to Tl 
training is (to the effect) "In this Xask you are to look at the word 
on the slide and listen to how it is. pronounced. Then you are to say 
the word." Maximum retrieval-reproduction delay will not exceed 30 
seconds. That seems a. reasonable time limit for Aq and clarification of 
Aq. We assume that E will be able to prolong intertrial intervals for 
purposes of providing additional clarification if this is required, but 
will assume that the 5 second intertrial delay value will reflect the 
averaue such intertrial clarification requirement (audio buffer rewind 
delay^is really less than 5 seconds for the short programs used in the 
Koehler study). Hence, training time calculations will reflect a general 
instructions time component that is 30 seconds plus 5(n - 1) seconds, 
with system switching delay viewed as concurrent to transmission of 
general instructions. (Some programs in addition will tape a very short 
instruction Ai at the front of each item; this event is an integral part 
of item time, rather than, of Aq time.) 

5. Housekeeping. Housekeeping consists of moving Ss into and out 
of the experimental situation and allied procedures not integral to the 
experiment as such. Housekeeping time will be computed for sessions, 
rather than for the running of programs per se'.^ 

6. Breaks. Break time will be computed for " sessions, rather than 
for running of programs per se. 

Since the Koehler study is used as the only basis for drawing im- 
plications for IDCMS when educational experiments are to be appreciably 
controlled by the system, one must ask whether these implications are 
simply ad hoc. One argument against the ad hoc characterization of the 
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present analysis is that although details of other educational experi- 
ments will differ from those for the Koehler study, other studies will 
stress the system in a comparable manner. Thus, for example, while 
intraitem event sequences may be more or less elaborate than those that 
Koehler employs, it may be that the only consequence is that item pre- 
sentation-response time will increase or decrease accordingly. That 
is, intraitem event types and durations reflected in the Koehler study 
should characterize many SWRL studies. We know that this will not be 
universally true; for example, intraitem event durations must be much 
shorter in tachistoscopic recognition studies. Thus, while we may reject 
the view that the analysis will be ad hoc in the sense of having only 
the most-narrowly particular implications for IDCMS, we cannot in con- 
sequence accept the view that the analysis has implications of sufficient 
generality to encompass all contemplated educational experimentation at 
SWRL. One way to insure sufficiently general guidance on what IDCMS 
must be able to do is to augment the present guidance through analysis 
of other sorts of training~e .g. , in music. Other papers might assess 
control implications while referencing to other sorts of training. 



Set Tl.O Materials 

II instruction will be given to the A8 Ss of Treatment Groups SI, 
'S2, CI, and C2 . All such instruction will use Tl.O materials. Ss 
will each receive A trials — on two items during Cycle 1, four items 
during Cycle 2, and three items during Cycle 3. We assume here that 
intertrial item order need not vary. Hence, the basic program will be 
an Item 1, ... * Item n sequence that, in audio buffer, is presented 
four times in succession in consequence of play, rewind, play, etc. , 
operations."' Aq time is 30 -f 5(4 - 1) , or A5 , seconds. 

Although item contents vary from one^ins tructional program to the 
next and even from one item to the next, the sequence of events for any 
item of any trial of any training program of any cycle of the Koehler 
study tends to take the same form — although with recursion in the case 
of complex items. The item event sequence referencing to Tl instruction 
is shown in Table A-A . 

The event sequence for a Tl^O item is graphed in Figure A-6 . E 
first commands retrieval of Tl.O and duplication to audio buffer. Since 
this occurs during Aq time, it need not be reflected in Figure A-6, ^ 
which describes any one-item sequence for Tl instruction. 

Consonant with foregoing assumptions, four versions of each Tl.O 
program are required — 2 intersubject item orders x 2 content* vers-if^ns. 
The materials requirement is shown in Table A-5. Item and program lengths 
are in normal-play audio tape. , 
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Table A-A 
Event Sequence for Tl Instruction 



Number 



Descriptor 



Event 



3 
4 
5 



Audio Instruction 



Video -f Audio Pre- 
sentation 

Response 

Audio Critique 

"Evaluative" Peed- 
back- 



A: "Repeat (say) the word 
after you hear it pro- 
nounced (spoken) ." 

V: W 
A: /W/ 

Sr: Try /W/ 

A: /W/ 

Ep: E.g. , "Stay with it." 
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Although allowed 10 seconds to respond. S typically will respond in 
a very few seconds. We assume an average response time of 5 seconds— 
probably an inflated value. Hence, single-item, single-presentation time 
is on the order of 19 seconds (see Figure A-6). Table A-6 shows instruc- 
tional time implications when the study is under system control and six 
Ss are instructed at a time. 

Table A-r6 
Tl.O Instructional Time 



Cycle 


Tr.xlt. 


Av. Negot. 
Time /I tern 
(sec) 


Ao 

(sec) 


Avi NegOt. 
Time /Prog, 
(min) 


'No. Groups 
of 6 


Predicted 
Tot. Tl Time 
(min) 


1 


8 


19 


^5 


/ 

3.3 


8 


26.4 


2 


16 


19 


45 


5.8 


8 


46.4 • 


3 


12 


19 


45 


4.6 ; 


. 8 


36.8 



Set T2.1 Materials / 

^ T2 instruction using T2.1 materials will be administered to Si and 
CI groups. T2.1 slides bear two printed stimuli—a word in normally- 
spaced form at the top of the slide aiid the same word in segmented form 
at the bottom of the slide — e.g.: 

SAT 
S-A-T 

Two responses are required to the contents of such slides. The 
first is a whole-word pronunciation response to the top printed stimulus 
the second, an appropriate sounding out of the word in segmented form. 
In both instances, S's response simply repeats an audio modelling of the 
response. To guide S concerning which printed stimulus is associated 
with the audio accompanyment that S is to repeat, the stimulus is boxed. 
Boxing of successive stimuli necessitates using two slides per item, 
rather than one. These two slides differ only in that the first boxes 
the top stimulus—eg., SAT— while the second boxes the bottom stimulus- 
e.g., S-A-T. 
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The T2«l item is a two-response item — as distinguished from the 
one-^response items of Tl instruction and items to which we will come 
directly, which range up to six-response value. The Koehler study con- 
trols both for total training time per cycle per treatment group and 
for total number of presentation-response (or critiqued instructional 
response) entities.'. Hence, number of responses per item is relevant both 
to quantification of the materials requirement and of instructional time. 

Event sequences for a presentation-response entity of T2 training 

using T2.1 materials have the same form as those for Tl training. The 

following sequence, which applies to the second, or segmented, stimulus 
of a Cycle 1 item, is illustrative. 

• A: "Repeat the (audio stimulus) after you hear it spoken." 

V: C-V-C , * 
A: /C/+/V/+/G/ 

Sr: Try /C/+/V/+/C/ 

A: /C/+/V/+/C/ 

Ep: E.g., "Simply amazing." 

Timing of the event sequence should follow that for Tl.O items ^ 
except that: a) per item costs will double for the two-response items 
of T2.1 and b) audio rendition of /C/+/V/+/C/ should cost two seconds 
rather than one. Hence, tape cost of the two-response item will be 30 
seconds. The materials requirement is shown in Table A-7. 

Consonant with greater complexity of the segmentation response, we 
assume T2.1 responses will average 6 seconds. Figure A-6 and foregoing 
comments support the view that average item negotiation time will be 
2 X 22, or 44, seconds. Table A-8 shows instructional time implications 
when the study is under system control and six Ss are instructed at a 
time. Aq computations are based on the 30 + 5(n - 1) seconds formula. 

Set T2.2 Materials 

T2 instruction using T2.2 materials will be administered to S2 and 
C2 groups. Materials differ from T2.1 materials primarily in how words 
are segmented, which is bipartitely, in number of stimuli per slide, and 
in item complexity. Table A-9 shows the pertinent data. 

Consonant with conventions established above, tape cost will be 15 
seconds per response — or 30 seconds per item for 2-response items and 
45 seconds per item for 3-response items. The materials requirement is 
shown in Table A-10 . 
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Table A-8 
T2.1 Instructional Time 









Av. Negot. 




Av. Negot. 


No. Gr. 


Predicted 


Cycle 


Gr. 


TxIxR 


Time/R 




Time/Prog. 


of 6 


Tot T2.1 Time 






(sec) 


(sec) 


(min) 




(min) 


1 


SI 


48 


22 


85 


19.0 


2 


38.0, 




CI 


24 


22 


55 


9.7 


2 


19.4' 


2 


SI 


96 


22 


85 


36.6 


2 


73.2 




CI 


48 


22 ■ 


55 


18.5 


2 


37.0 


3 


SI 


48 


22 


65 


18.7 


2 


37.4 




CI 


24 


22 


45 


9.1 


2 


18.2 
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Table A-9 

\ Programs, Response Levels, and Illustrative Items 

\ for T2 Training Using T2.2 Materials 



Cjfle 



Program 



No. Rs 



Illustration 



1.1 



SAT 
S-AT 
A-T 



1.2 



2.1 



2.2 



2 
3 



SAT 
S-AT 

SIN 
S-IN 

3PIN 
SP-IN 
I-N 



"2.3 



3.1 



3.2- 



2 
2 
3 



SPIN 
"SP-IN 

INK 
I-NK 

LINK 
L-INK 
I-NK 



3.3 



LINK 
L-INK 



ERIC 



40 



39 



(0 

e 

o 

H > 



to to 

Q) U 

c3 > 
u 

0) 

> a. 



00 0} 
O M 
U 0) 

















to 








M 




u 








^ C 




> 












e 








(1) 








M 




to 








M 




•■1 


PS 


d) 










o 


0) 


iJ 


M 




Pi 


M 


O 


1 

< 


to 














QJ 


fTl 




• 




*H 


60 


60 C 




1 M 


O 


C -H 




'S 


M 


0) 6 




4J 




.J ^ 
























♦ /*-N 






B 


60 C 






Q) 


C 0) 




H 


4J 


Q) to 






M 


.J ^ 








(0 








as 
















4J 
















M 








H 








• 








M 








O 
















60 








O 








U 
















* 








o 








>^ 








u 



CNJOOOOCNJOO COvD<r 



in 
H 



CO 



o 00 in 
• • • 

fH O O 



O 
CO 



O 
CO 



in 



CO 



o 

CO 



o 

iCO 



in 



o 

CO 



CNJ CN» CVJ CVJ CNJ 



<rc>j vDco fHin tncNi voto r^co <rc^j <rcNj 



CNJCNJ^CNJC4 CNJCNJ cvjcvi cvjcvj c^cvj CNicvJ <>Jri 
CO U'.-*' f/> u cocj wcj wo cou cou cou 



r-4 CvJ CO fH CM CO 

• • • ' * • • 

CM CM CvJ CO CO CO 



CM 



CO 



41 



Again we assume an average negotiation time per response of 22 
seconds. Table A-11 shows instructional time implications when the 
study is under system control and six Ss are instructed at a time. 



Set T3.0 >laterials 

All 72 Ss receive T3 training using T3.0 materials. All Ss receive 
this training in the same amount. The same 6 letter-sound combinations 
are taught during Cycles 1 and 2, with 2 additional letter-sound combin- 
ations added to the set during Cycle 3 training. Durihg Cycles 1 and 
2, the set of 6 rules is split into subsets of rules\ each for pre- 
liminary training p; oses. S first receives 2 "trials \on each rule of 
the first subset, but with randomization across trials .\ Next he receives 
2 trials on each rule of the second subset under tKe'. same procedure. 
Finally, he receives A trials on each rule for the set ks a whole. The 
same procedure is followed in Cycle 3 except that set size is 8 and sub- 
set size is 4. Again, two material'' sets are used. Table A-12 illus- 
trates the materials requirement foi e materials set. Here it is 
important that a degree of trial-to-c i,al randomi station of items occur. 
Half of the odd-numbered Ss might receive the odd-numbered programs of 
Table 4;. half of the even- numbered Ss, the even-numbered programs. The 
remaining Ss would receive comparable programs from a second materials 
set. (Of passing interest, these materials lend themselves well to on- 
line composition of randomized sequences. However, if the system has 
no such capability, then one must preform the sequences and store these 
in audio master reproduction as required.) The last column of Table 
A-12 illustrates the rewind-replay operation for a program stored in 
audio buffer. That is, when four trials must occur, one rewinds the two- 
trial program and repeats the program. Stop codes should intervene 
between the single-trial components of these programs. 

The same sequence of events referencing to presentation of a given 
letter-sound combination charat:terizes T^ t-rai^ving-as-eharaet-eri-zed- 
presentation of a given item or part-item during Tl and T2 training. 
Again video-audio presentation is followed by S's attempt to repeal- 
audio. This in turn is followed by a critiquing representation or audio 
and evaluative feedback from E. Perhaps the only difference is that 
average response time should be shorter—let us say 3 seconds — and eval- 
uative feedback shorter also—let us say 5 seconds. It also appears 
tenable that the audio instruction fronting each item should drop out. 
In wonsequence, audio tape per item should be on the order of 7.5 seconds. 
Allowing 5 seconds of tape for stop intervals, programs of the A1-A4 
type will be 50 seconds long; those of the B1-B4 type, 65 seconds; those 
of the A5-A6 type, 95 seconds; those of the B5-B6 type, 125 seconds. 
Tlie materials requirement is shown in Table A-13. 

- Consonant with foregoing remarks, presentation-response time per 

item should be on the order of 15 seconds. Table A- 14 shows instructional 

time implications vAien the study is under system control and six Ss are 
instructed at a time. i 
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Table A-12 



Two-Trial T3.0 Programs Featuring Intertrial Switching of Item Order 



Cycle 


Program^ 


Trials 1-2 


Trials 3-4 


1-2 


/a 1 

/Al 


SPA-PAS 






/ A2 


APS-PSA 






/' A3 


NTI-TIN 






/ A4 


ITN-TNI 






/ 








A5 


SANTIP-TNAPSI 


Repeat A5 




A6 


APNITS-PASTIN 


Repeat A6 


3 


Bl 


KSAP-SKPA 






B2 - 


AKPS-PASK 






B3 


NLIT-LNTI 






B4 


TILN-ILTN 






B5 


LSATKNIP-KSLINTPA 


Repeat B5 




B6 


STNPLAKI-PNLKATIS 


Repeat B6 



^All of these programs belong to one content version. The other 
version uses different consonant letter-sound rules. Those who receive 
the Table A-12 version receive only half of the tabled programs — the 
odd-numbered ones or the even-numbered ones. These programs differ 
from previous ones in being of two-trial length, to accommodate a require- 
ment for inter trial switching of item order without incurring the usual 
retrieval-reproduction delay between trials. 
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Set T4.1 Materials 

TA Instruction using TA^l materials Is given to Groups Bl and CI, 
Table A-15 shows the forms of Items across cycles. 

Table A-15 

Illustrative TA.l Items 



Cycle 


Illustrative Item 


1 


P-A-N 




PAN 


2 


SP-A-N 




SPAN 




S-A-NK 




SANK 



The basic event sequence is as indicated for earlier instruction. 
Setting tape per response at 15 seconds, then the two-response items of 
T4 training using TA,1 materials use 30 seconds of tape. The materials 
requirement is shown in Table A-16 • 

Assuming as earlier an average negotiation time per response of 22 
seconds, Table A-17 shows instructional time implications when the study 
is under- system control and six Ss are instructed at a time. 



Set T4,2 Materials 

T4 instruction using TA,2 materials is given to Groups B2 and C2, 
Although segmentation is bipartite rather than tripartite, materials are 
more extensive than for training using TA,1 materials. The materials 
for one content version of TA,2 programs is shown in Table A-18, 

A TA,2 program of the Program 1,1 type requires S to respond 4 times 
to each of 2 items. Items range from 2-response (e,g, , Program 1,2) to 
6-respo'nse (Program 2,2), The TA,2 materials requirement is shown in 
Table A-19 , Again we assume 15 seconds of tape per response. 

Assuming again an average negotiation time per response of 22 sec- 
onds, Table A-20 shows . istructional time implications when the study 
is under system control and six Ss are instructed at a time. 
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Table A-18 
Materials foAOne Content Version 



\ 


Cycle 


Program 


- \ 

Icems for One Content Version . 




(2) (3) (4) 



1.1 



1.2 




P-AN 
PAN 

P-AN 
PAN 



2.1 



A-N 
AN 



I-P 
IP 



SP-AN 
SPAN 



T-IP 
TIP 



2.2 



A-P 
AP 



N-AP 
NAP 

SN-AP 
SNAP- 



2.3 



SP-AN T-IP N-AP SN-AP 
SPAN TIP NAP SNAP 



3.1 



A-NK 
ANK 



I-NT 
INT 



S-ANK 
SANK 



T-INT 
TINT 



3.2 



S-ANK 
SANK 



T-INT 
TINT 



ERIC 



^Single items read down. Responses per item range from 2 to 6. 
The content version employs lA unique printed stimulus layouts. Since 
these must appear with one or' the other of the two printed stimuli boxed, 
the content version implies 28 video frames. Two content versions would 
require 56 video frames if the second version showed the same overlapping 
pattern across programs as does the first. 
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Magnitude of Training. ^ 

Table A-21 shows total number of training responses and total crain 
ing time, by treatment grdup and cycle. Response values ^coincide with 
those of the Koehler formulation. Training time values are those gen- 
erated above. While the study in manual mode execution might not allot 
the values reached above for presentation-response sequences, study 
scheduling suggests that overall training time values are approximately 
those reached in Table A-21 and Table A-22 . The study allocates six 
sessions to the training of any S. If each session uses 20-24 minutes 
for actual training, then study training time will correspond to that 
shown in Table A-22, which summarizes training across skills and cycles. 
Excepting for slightly longer S2 and C2 Cycle 2 and Cycle 3 training 
times, the tables show marked .intracycle matches for training time 
across treatment groups . 
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Table A-21 

Response and Training Time Totals, by Treatment Group and Cycle 



Cycle 1 Cycle 2 Cycle 3 

Gr. Materials Tng. Tng. Tng. 

Prog. Rs Time Prog. Rs Time Prog. Rs Time 
(min) (min) (miri) 



SI 



Bl 



Tl.O 


1.1 


8 


3.3 


2.1 


16 


5l8 


3.1 


12 


4.e 


T2.1 


1.1 


48 


19.0 , 


2.1 


96 


36.6 


•3.1 


48 


18.7 


T3.0 


1.1 


6 


2.1 


1.1 


6 


2.L.. 


2.1 


8 


2.6 




1.2 


6 


2.1 


1.2 


6 


2.1 


2.'2~ 


8 


2.6 




1.3 


24 


6.8 


1.3 


24 


6.8 


~ 2.3 


32 


8.8 


Totals 


J 


92 


33.3 




148 


53.4 




108 


37.3 


T3.0 


1.1 


6 


2.1 


1.1 


6 


2.1 


2.1 


8 


2.6 




1.2 


6 


2.1 


1.2 


6 


2 .1 


2.2 


8 


2.6 




1.3 


24 


6.8 


1.3 


24 


6 .8 


2.3 


32 


8.8 


T4.1 


1.1 


56 


22.1 


2-.1 


112 


42.7 


3.1 


60 


23.7 


Totals 




92 


33.1 




148 


53.7 




108 


37.7 



Tl.O 


1.1 


8 


3.3 


2.1 


16 


5.8 


3.1 


12 


4.6 


T2.1 


1.1 


24 


9.7 


2.1 


48 


18.5 


3.1 


24 


9.1 


T3.0 


1.1 


6 


2.1 


1.1 


6 


2.1 


2.1 


8 


2.6 




1.2 


6 


2.1 


1.2 


6 


2.1 


2.2, 


8 


2.6 




1.3 


24 


6.8 


1.3 


24 


6.8 


2.3 


32 


8.8 


T4.1 


1.1 


24 


9.7 


2.1 


48 


18.5 


3.1 


24 


9.7 


Totals > 




92 


33.7 




148 


53.8 




108 


37.4 



S2 



Tl.O 


1.1 


8 


3.3 


2.1 


16 


5.8 


3.1 


12 


4.6 


T2.2 


1.1 


24 


9.6 


2.1 


44 


17.5 


3.1 


28 


11.3 




1.2 


24 


9.7 


2.2 


30 


11.8 


3.2 


12 


5.2- 










' 2 .,3 ' 


24 


9 .7 


3.3 


8 


3.7 


T3.0 


1.1 


6 


2.1 


1.1. 


6 


2.1 


2.1 


8 


2.6 




1.2 


6 


2.1 


1.2 


6 


2.1 


2.2 


8 


2.6 




1.3 


24 


6:8 


1.3 


24 


6.8 


2.3 


32 


8.8 


Totals 
• 




92 


33.6 




150 


55.8 




108 


38.8 
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Table A-21 - continued 







Cycle 


1 


Cycle 


2 


Cycle. 


3 


Gr 


Materials 






Tng. 






Tng. 






Tng. 






Prog. 


Rs 


Time 


Pr'ig. 


Rs 


Time 


Prog. 


Rs 


Time 








(min) 






(min) 






(min) 


R2 




1.1 


6 


2.1 


1.1 


6 


2.1 


2.1 


8 


2.6 






1..2 


6. 


2 . 1 


1.2 


6 


2.1 


2.2 


8 


2.6 






3 


24 


6 .8 


1.3 


24 


6 .8 


2.3 


32 


8.8 




TZi '> 


x.l 


32 


12 ,5 


2.1 


32 


12.5 


3.1 


32 


12.5 






1.2 


24 


9.7 


2.2 


30 


11.8 


3.2 


28 


11.3 












2.3 


48 


18.5 










iocais 




92 






146 


53.8 




108 


■^7 .8 


C2 


Tl.O 


1.1 ' 


8 


3.3 


2.1 


16 


5.8 


3.1 


12 


4.6 




T2 .2 


1.1 


12 


5.0 


2.1 


20 


8.2 


3.1 


12 


5.1 






1.2 


12 


5.1 


2.2 


12 


5.0 


3.2 


6 


■ 2.8 












2.3 


12 


5.1 


3.3 


4 


2.1 




T3.0 


1.1 


6 


2.1 


J..1 


6 


2.1 


2.1 


8 


2.6 






1.2 


6 


2.1 


1.2 


6 


2.1 


2.2 


8 


2.6 






1.3 


24 


6.8 


,1.3 


24 


6.8 


2.3 


32 


8.8 




T4.2 


1.1 


16 


6.5 


2.1 


16 


6.5 


3.1 


16 


6 .5 






1.2 


8 


3.5 


2.2 


12 


5 .0 


3.2 


12 


5.1 












2.3 


24 


9 .5 










Totals 




92 


34.4 




148 


56.1 




110 


40.2 
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